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O ' Abstract 

(N 

Oh' The purpose of this short paper is to provide a theoretical analysis for the consensus 

problem under nonlinear protocols. A main contribution of this work is to generalize 

CN . the previous consensus problems under nonlinear protocols for networks with undi- 

rected graphs to directed graphs (information flow). Our theoretical result is that if the 

Q ! directed graph is strongly connected and the nonlinear protocol is strictly increasing, 

^ ■ then consensus can be realized. Some simple examples are also provided to demon- 

strate the validity of our theoretical result. 
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I Introduction 

In networks of dynamics agents, "consensus" means that all agents need to agree upon 
certain quantities of interest that depend on their state. A "consensus protocol" is an interac- 
tion rule that specifies the information exchange between an agent and all of its neighbors on 
the network, and enables the network to achieve consensus via a process of distributed deci- 
sion making. Consensus problems (see [Hl-llll) have a long history in the field of computer 
science, particularly in automata theory and distributed computation. Recently, distributed 
coordination of networks of dynamic agents has attracted several researchers from various 
disciplines of engineering and science due to the broad applications of multi-agent systems 
in many areas, such as collective behavior of flocks and swarms [I51|6l, synchronization of 
coupled oscillators S-flU, and so on. 

Until now, most papers in the literature mainly concern the consensus problem under lin- 
ear protocols, with the connection topologies time-varying, state-dependent ( see im-H). 
Even in those papers investigating nonlinear protocols, like [!2l[3l|9l, a strong assumption 
on networks should be satisfied: the interaction topology should be bidirectional. However, 
unidirectional communication is important in practical applications and can be easily incor- 
porated, for example, via broadcasting. Also, sensed information flow which plays a central 
role in schooling and flocking is typically not bidirectional. 

So, in this paper, we will look at the consensus problem in networks of dynamic agents, 
described by ordinary differential equations (ODE), under nonlinear protocols with directed 
topology. This note can be regarded to extend consensus results under undirected graphs in 
All m to the case of directed graphs. Our approach is to model the communication topology 
as a graph, then by merging spectral graph theory, matrix theory and control theory, we can 
prove rigorously that if the directed graph is strongly connected and the nonlinear protocol 
is strictly increasing, then consensus problem can be realized. 

An outline of this paper is as follows. In Section II, we define the consensus problem on 



graphs. In Section III, we first define the nonlinear protocol, then based on some lemmas of 
algebraic graph theory and matrix theory, we obtain the main theoretical result. In section 
IV, two simple examples are also provided to demonstrate the effectiveness of our theoretical 
result. We conclude this paper in Section V. 

II Consensus problem on graphs 

Definition 1. (Weighted Directed Graph) Let Q = (V, S, A) be a weighted digraph (or 
directed graph) with the set of nodes V = {vi, ■ ■ ■ , f„}, set of edges S C V x V, and a 
weighted adjacency matrix A = {aij) with nonnegative adjacency elements a-ij. An edge of 
Q is denoted by Cij = (fj, Vj) G S, which means that node vi receives information from node 
Vj, and we assume that Vi ^ Vj for all e^, so the graph has no self-loops. The adjacency 
elements associated with the edges of the graph are positive, i.e., e^ G £ <^=^ aij > 0. 
Moreover, we assume an = for all i G 1, ■ ■ ■ ,n. The set of neighbors of node vi is 
denoted by Ni = {vj G V : {vi,Vj G S)}. The corresponding graph Laplacian L = (lij) 
can be defined as 

U^ = \ ^Um^«^^' ' = 3 (1) 

Definition 2. (Strongly Connected Graph) A path on a graph Q = (V, S, A) of length n* < 
nfrom v^^ to Vi^^ is an ordered set of distinct vertices {f jg , ■ ■ ■ , vi^^ } such that {vi^_^ , vi^ ) G 
£, for all i = 1, ■ ■ ■ ,n*. A graph in which a path exists from every vertex to every vertex 
is said to be strongly connected (SC). Obviously, irreducibility of the graph Laplacian for a 
graph can imply its strong connectivity. 

Without loss of generality, let Xi E R denote the value of node Vi,i = 1 , ■ ■ ■ , n. We refer 
to Qx = (Q, x) with X = {xi,- ■ ■ , Xn)'^ as a network (or algebraic graph) with value x and 
topology (or information flow) Q. The value of a node might represent physical quantities 
including attitude, position, temperature, voltage, and so on. 



Definition 3. (Consensus) Consider a network of dynamic agents with Xi = Ui interested 
in reaching a consensus via local communication with their neighbors on a graph Q^- By 
reaching a consensus, we mean converging to a one -dimensional agreement space charac- 
terized by the following equations: 

Xi = X2 = ■■■ =Xn (2) 

This agreement space can be expressed as x = [31 where 1 = (1, ■ ■ ■ , 1)^ and P E Ris the 
collective decision of the group of agents. 

Lemma 1. (See /17]/j Suppose L = (lij) is a graph Laplacian of a bi-graph Q = (V, S,A) of 
n nodes, i.e., Uj = lji,foranyi,j G 1, ■ ■ ■ ,n. The following sum-of-squares (SOS) property 
holds, for any x = (xi, ■ ■ ■ , Xn)'^, 



III Consensus Analysis 



A. Nonlinear consensus protocol 

In this paper, we propose the following nonlinear consensus protocol h{-) : R —> R 
to solve consensus problems in a network of continuous -time integrator agents with fix 
connection topology Q^'- 

Xi{t) = ^aijlh{xj{t)) -h{xi{t))j, i = l,---,n (4) 

If L = (lij) is the corresponding graph Laplacian of Q^ defined in Definition 1, then the 
above equations also can be rewritten as 

n 

Xi{t) = -"^kjhixji^t)), i = l,---,n (5) 

Throughout this paper, we assume that h{-) is a strictly increasing function. Without 
loss of generality, we assume /i(0) = 0. 



B. Algebraic graph theory and matrix theory 

In this part, we introduce some basic concepts, notations and lemmas in algebraic graph 
theory and matrix theory that will be used throughout this paper. 

Lemma 2. (Spectral localization. See [I]) Let Q be a strongly connected digraph of n 
nodes. Then rank{L) = n — 1, and all nontrivial eigenvalues ofL have positive real part. 

Remark 1. Lemma 2 holds under a weaker condition of existence of a directed spanning 
tree for Q. Q has a directed spanning tree if there exists a node r (root) such that all other 
nodes can be linked to r via a directed path (see relating papers /El ^)- In fact, in digraphs 
with spanning tree (leader-follower model), the root node is commonly known as a leader, 
which does not receive any information from other nodes. 

Lemma 3. Assume Q is a strongly connected digraph with graph Laplacian L, then (110]) 

L 1 = (1, 1, ■ ■ ■ ,1)^ is the right eigenvector of L corresponding to eigenvalue with 
multiplicity 1; 

2. Let C, = {^1, ^2, ■ ■ ■ , ^n)'^ be the left eigenvector of L corresponding to the eigenvalue 
0. Then, ^i > 0, i = 1,2,- ■ ■ ,n; and its multiplicity is 1. In the following, we always 

assume J2^=i ^i — ^■ 

C. Main results 

In this part, we will give a theorem, which shows that if the directed graph is strongly 
connected and the nonlinear function is strictly increasing, then the consensus problem can 
be realized. 

Theorem 1. Suppose the digraph Q^ is a strongly connected. L is the corresponding graph 
Laplacian in Definition 1. Then consensus can be realized globally for all initial states 
by the nonlinear protocol (|51) and the group decision is x^ = '^^^i^iXi{0), where ^ = 
(^i5 ■ ■ ■ 5 ^ra)^ '* defined in Lemma 3. 
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Before the proof of Theorem 1 , we introduce a reference node (or virtue leader) x^ (t) 
Yl'^=i^iXi{t). It is clearly 



n n 



^«(^) = X^ 6ii(^) = -^^i^ lijh{xj{t)) = - ^ h{xj{t)) ^ iittij = (6) 

i=l i=l j=l j=l 4=1 

Therefore, we obtain the following simple but useful proposition, which plays an important 
role in the discussion of final group decision. 

Proposition 1. x^{t) is time-invariant for the network (O, i.e., x^ = ^"=i^ja;i(0) = x^(t) 
for all t > 0. 

Proof of Theorem 1 Denote x^ = Z]iLiCj^j(0), x{t) = (xi(t),--- ,x„(t))'^, and 
H{x{t)) = (/i(xi(t)), ■ ■ ■ , h{xn{t))Y . Then equations ([5]) can be rewritten in the compact 
form as 

x{t) = -LH{x{t)) (7) 



Define a function as: 

-Xi{t) 



V^(x(t)) = V6 / h{s)ds 



(8) 



Obviously, V{x{t)) > is radially unbounded, and V{x{t)) = if and only if a;(t) = 0. 

Denote B = (bij) = (EL + LF'E)/2, where S = diag(^). It is easy to check that B is 
a symmetric matrix with zero row-sum, i.e., B can be regarded as a graph Laplacian of a 
bi-graph. Differentiating V{x{t)) and using Lemma[Il we have 

n 

v{x{t)) = -Y^^^h{x,{t))Y,kM^At)) 

= -H{x{t)fELH{x{t)) = -H{x{t)fBH{x{t)) 

= ^6,,(/i(x,(t)) - h{xj{t))f < 0, (since 6,,- < 0) (9) 

i>j 



Thus, < V{x{t)) < V{x{0)), which implies x{t) is bounded for any t > 0. And the 
largest invariant subset (r2-limit set) for the equations Q is 

Q = {x : Xi{t) = Xj{t);i,j = !,■■■ ,n} (10) 

Now, we claim that for alH = 1, ■ ■ ■ , n, lim Xj(t) = xc. 

In fact, if tm ^ C)0 and for alH, j = 1, ■ ■ ■ , n, Xi{tm) -^ P, then, 

n n 

x^ = lim Y^ iiXi{t^) = \^fiP = (3 (1 1) 



t— +00 ■ 



which means that x^ is the group decision of the consensus problem. Theorem 1 is proved 
completely. 

Remark 2. Let h{xi{t)) = axi{t) with a > 0, The nonlinear function h{-) becomes a 
linear function, therefore, Theorem 1 can be regarded as a generalization of the consensus 
problem under linear protocols. It also give a simple proof for the consensus problem under 
linear protocols, too. 

Remarks. Assume {h{wi) — h{w2))/{wi~W2) > a holds for a > and any wi ^ W2 & R- 
In this case, we have 

V{x{t)) = Y,h,{h{xm - h{x,{t))? < «'$^%(x.(t) -x,(t))2 (12) 

i>j i>j 

and the consensus problem will be realized exponentially. Moreover, it seems that the non- 
linear protocol can be realized faster than that under the linear protocol h{w) = aw. 
Therefore, nonlinear protocols can be applied to calculate the average value of large-scale 
networks more effectively. 



TV Numerical examples 

In this section, we give two numerical simulations to verify the validity of our theory. 



Consider a network of a strongly connected digraph ^^ with 3 agents 



iii^) = -^kjh{xj{t)), 

3=1 



i = 1,2,3 



where Xj(t) G R and the Laplacian of Qx is 

/ 2 -1 -1 \ 
L= 1-1 (13) 

V-1 1 ; 

Its left eigenvector with eigenvalue is ^ = (1/4, 1/4, 1/2)^. 

Example 1 : In this simulation, the nonlinear protocol is assumed as h (xj (t) ) = axi (t) + 

sin(xi(t)), i = 1, 2, 3. The initial value is taken as: (a;i(0), 0:2(0), ^3(0)) = (1, 2, 3). 

Case 1. a = 2. In this case, then h'{-) > 1. By Theorem 1, consensus of (fT3l) can be 
realized, and the decision value is X]i=i 6^i(0) = 1/4 + 2/4 + 3/2 = 2.25, see Figure[TJa); 



Case 2. a = 0.5. In this case, h{-) is not an increasing function, and consensus of (|T3l) 
may not be realized, see Figure [Ub). 

Example 2: In this simulation, we choose two protocols. One is the nonlinear protocol 



h*{xi) 



The other is the linear protocol 



^1 


; if 


Xj > 1 


\f^i 


; if 


< Xi < 1 


\J-Xi 


; if 


- 1 < Xi < 


-x? 


; if 


X,- < -1 



(14) 



h{xi) = Xi/2 i = 1,2,3 



(15) 



Simple calculations show that the derivative of /i*(-) is no less than 1/2. The consensus 
problem under the nonlinear protocol (fl?)) can be realized faster than that under the linear 
one (IT?]). 





5 10 

(b) Timet 



15 



Figure 1 : Consensus problem of (fT3]) under different nonlinear functions 
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Figure 2: Consensus problem of (fT3]) under nonlinear and linear protocols 

In Figure |2l the dynamical behavior of the network (fT3l) under the nonlinear proto- 
col /i*(x) defined in (fT4l) is displayed by line with star. Instead, for the linear protocol 
h(x) defined in (flSl) . it is displayed by line without star. The initial value is chosen as: 
(xi(0),X2(0),X3(0)) = (—0.4,4,0.8). Simulations do show that consensus under the non- 
linear protocol (fT4l) is much faster than that under linear protocol (fTS]) . 



V Conclusions 



In this paper, we investigate the consensus problem under nonlinear protocols. We gen- 
eralize the results for undirected graphs to directed graphs. Moreover, our model can also 
be regarded as the generalization of consensus problem under linear protocols to nonlinear 
protocols. All the existing results with respect to consensus under linear protocols with 
directed/undirected graph and consensus under nonlinear protocols with undirected graph 
can be easily obtained by our approach. The convergence analysis is presented rigorously. 



based on tools from algebraic graph theory, matrix theory, and control theory. Two simple 
examples are provided to show the effectiveness of the theoretical result. 
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